Speech Recognition via fNIRS Based Brain Signals

In this paper, we present the first evidence that perceived speech can be identified from the listeners' brain signals measured via functional-near infrared spectroscopy (fNIRS)—a non-invasive, portable, and wearable neuroimaging technique suitable for ecologically valid settings. In this study, participants listened audio clips containing English stories while prefrontal and parietal cortices were monitored with fNIRS. Machine learning was applied to train predictive models using fNIRS data from a subject pool to predict which part of a story was listened by a new subject not in the pool based on the brain's hemodynamic response as measured by fNIRS. fNIRS signals can vary considerably from subject to subject due to the different head size, head shape, and spatial locations of brain functional regions. To overcome this difficulty, a generalized canonical correlation analysis (GCCA) was adopted to extract latent variables that are shared among the listeners before applying principal component analysis (PCA) for dimension reduction and applying logistic regression for classification. A 74.7% average accuracy has been achieved for differentiating between two 50 s. long story segments and a 43.6% average accuracy has been achieved for differentiating four 25 s. long story segments. These results suggest the potential of an fNIRS based-approach for building a speech decoding brain-computer-interface for developing a new type of neural prosthetic system

In silico vs. Over the Clouds: On-the-Fly Mental State Estimation of Aircraft Pilots, Using a Functional Near Infrared Spectroscopy Based Passive-BCI

There is growing interest for implementing tools to monitor cognitive performance in naturalistic work and everyday life settings. The emerging field of research, known as neuroergonomics, promotes the use of wearable and portable brain monitoring sensors such as functional near infrared spectroscopy (fNIRS) to investigate cortical activity in a variety of human tasks out of the laboratory. The objective of this study was to implement an on-line passive fNIRS-based brain computer interface to discriminate two levels of working memory load during highly ecological aircraft piloting tasks. Twenty eight recruited pilots were equally split into two groups (flight simulator vs. real aircraft). In both cases, identical approaches and experimental stimuli were used (serial memorization task, consisting in repeating series of pre-recorded air traffic control instructions, easy vs. hard). The results show pilots in the real flight condition committed more errors and had higher anterior prefrontal cortex activation than pilots in the simulator, when completing cognitively demanding tasks. Nevertheless, evaluation of single trial working memory load classification showed high accuracy (>76%) across both experimental conditions. The contributions here are two-fold. First, we demonstrate the feasibility of passively monitoring cognitive load in a realistic and complex situation (live piloting of an aircraft). In addition, the differences in performance and brain activity between the two experimental conditions underscore the need for ecologically-valid investigations

Applying Functional Near Infrared (fNIR) Spectroscopy to Enhance MIS Research

This review paper introduces the emerging technology of optical brain imaging, also known as functional near infrared (fNIR) spectroscopy, and discusses its potential role in enhancing theory and methodology used in MIS research. We discuss basic fNIR principles including the technique’s safe and portable nature, which allows ambulatory brain activity assessment in real world environments. We then touch on the neural correlates that fNIR measures, and the cortical oxygenation changes in the dorsal and anterior regions of the prefrontal cortex. We compare fNIR with traditional neuroimaging methods such as fMRI and PET. We also list case studies, future directions, and potential approaches relevant to MIS. fNIR may be used to inform theory and improve assessments in MIS-based studies, including informing theory, by identifying neural correlates, studying constructs that could not easily if at all be measured with traditional methods, applying objective constructs that subjects are unaware of, and designing better surveys

A Systematic Review of Integrated Functional Near-Infrared Spectroscopy (fNIRS) and Transcranial Magnetic Stimulation (TMS) Studies

Background: The capacity for TMS to elicit neural activity and manipulate cortical excitability has created significant expectation regarding its use in both cognitive and clinical neuroscience. However, the absence of an ability to quantify stimulation effects, particularly outside of the motor cortex, has led clinicians and researchers to pair noninvasive brain stimulation with noninvasive neuroimaging techniques. fNIRS, as an optical and wearable neuroimaging technique, is an ideal candidate for integrated use with TMS. Together, TMS+fNIRS may offer a hybrid alternative to “blind” stimulation to assess NIBS in therapy and research.Objective: In this systematic review, the current body of research into the transient and prolonged effects of TMS on fNIRS-based cortical hemodynamic measures while at rest and during tasks are discussed. Additionally, studies investigating the relation of fNIRS to measures of cortical excitability as produced by TMS-evoked Motor-Evoked-Potential (MEP) are evaluated. The aim of this review is to outline the integrated use of TMS+fNIRS and consolidate findings related to use of fNIRS to monitor changes attributed to TMS and the relationship of fNIRS to cortical excitability itself.Methods: Key terms were searched in PubMed and Web-of-Science to identify studies investigating the use of both fNIRS and TMS. Works from Google-Scholar and referenced works in identified papers were also assessed for relevance. All published experimental studies using both fNIRS and TMS techniques in the study methodology were included.Results: A combined literature search of neuroimaging and neurostimulation studies identified 53 papers detailing the joint use of fNIRS and TMS. 22/53 investigated the immediate effects of TMS at rest in the DLPFC and M1 as measured by fNIRS. 21/22 studies reported a significant effect in [HbO] for 40/54 stimulation conditions with 14 resulting an increase and 26 in a decrease. While 15/22 studies also reported [HbR], only 5/37 conditions were significant. Task effects of fNIRS+TMS were detailed in 16 studies, including 10 with clinical populations. Most studies only reported significant changes in [HbO] related measures. Studies comparing fNIRS to changes in MEP-measured cortical excitability suggest that fNIRS measures may be spatially more diffuse but share similar traits.Conclusion: This review summarizes the progress in the development of this emerging hybrid neuroimaging & neurostimulation methodology and its applications. Despite encouraging progress and novel applications, a lack of replicated works, along with highly disparate methodological approaches, highlight the need for further controlled studies. Interpretation of current research directions, technical challenges of TMS+fNIRS, and recommendations regarding future works are discussed

Innovations in surgery between the past and future: A narrative review of targeted literature

Innovation is the introduction of a new method or technology designed to change the way things are done. History is full of remarkable innovations in surgery over the years as surgeons have always been innovating and pioneering latest techniques and equipment that can benefit the mankind. Though persistent, progress has been far from uniform. Despite all the bells and whistles that these innovations bring to the table, the little acknowledged fact is that they are only accessible to a very small proportion of the global population. Five billion people on this planet do not even have access to an operating room when needed. It has been reported that conditions requiring surgery are responsible for one-third of all the deaths in the world. The current narrative review was planned to focus on the importance of innovations in surgery, to highlight the problems that were faced by resource-restricted countries in the past, and the necessity of innovative solutions to improve global surgical care in the future

Using MazeSuite and Functional Near Infrared Spectroscopy to Study Learning in Spatial Navigation

MazeSuite is a complete toolset to prepare, present and analyze navigational and spatial experiments1. MazeSuite can be used to design and edit adapted virtual 3D environments, track a participants' behavioral performance within the virtual environment and synchronize with external devices for physiological and neuroimaging measures, including electroencephalogram and eye tracking